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Abstract. Two new networks are introduced that resemble small- world properties. 
These networks are recursively constructed but retain a fixed, regular degree. They 
possess a unique one-dimensional lattice backbone overlayed by a hierarchical sequence 
of long-distance links, mixing real-space and small-world features. Both networks, 
one 3-regular and the other 4-regular, lead to distinct behaviors, as revealed by 
renormalization group studies. The 3-regular network is planar, has a diameter growing 
as y/N with system size TV, and leads to super-diffusion with an exact, anomalous 
exponent d w = 1.306 . . ., but possesses only a trivial fixed point T c — for the Ising 
ferromagnct. In turn, the 4-regular network is non-planar, has a diameter growing 
as ~ , exhibits "ballistic" diffusion (d w = 1), and a non-trivial ferromagnetic 

transition, T c > 0. It suggest that the 3-regular network is still quite "geometric" , while 
the 4-regular network qualifies as a true small world with mean-field properties. As an 
engineering application we discuss synchronization of processors on these networks. 



PACS numbers: 89.75.-k, 64.60.ae, 64.60.aq, 05.50.+q 
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The description of the "6-degrees-of-separation" phenomenon in terms of small- 
world (SW) networks by Watts and Strogatz [1] has captured the imagination of many 
researchers, and was particularly timely as we suddenly found ourselves in a networked 
world [21 EH H]- Such a rich environment requires a diverse set of tools and models 
for their understanding. Statistical physics, with its notion of universality, provides 
powerful methods for the classification of complex systems, like the renormalization 
group (RG) [51 © HE]. 

Here, we introduce and study a set of graphs which reproduce the behavior of 
SW networks without the usual disorder inherent in natural networks. Instead, they 
attain these properties in a recursive, hierarchical manner that is conducive for RG. The 
motivation is comparable to regular scale-free networks proposed in Refs. [HI [10] or the 
Migdal-Kadanoff RG [HI [T21 H3J. The benefit of these features is two-fold: For one, we 
expect that many SW phenomena can be studied analytically on these networks, and 
that they will prove as useful Migdal-Kadanoff RG has been for physical systems 

in low dimensions. Furthermore, possessing such well-understood and regular networks 
is a tremendous advantage for engineering applications, as it is difficult to manufacture 
realizations of random networks reliably when we can ascertain their behavior only in the 
ensemble average. Here, we introduce these networks by discussing their geometry and 
physical processes on them, such as diffusion, phase transitions, and synchronization. 

Each network possesses a geometric backbone, a one-dimensional line of N = 2 k 
sites, either open or closed into a ring. To obtain a SW hierarchy, we parameterize 

n = T (2j + 1) (1) 

uniquely for any integer n^O, where j = 0, ±1, ±2, . . . labels consecutive sites within 
each level % > of the hierarchy. For instance, % = refers to all odd integers, % = 1 
to all integers once divisible by 2 (i.e., ±2, ±6, ±10, . . .), and so on. In these networks, 
both depicted in Fig. [U in addition to its nearest neighbor in the backbone, each site is 
also connected with (one or both) of its neighbors within the hierarchy. For example, 
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Figure 2. (Color Online) Sequence of shortest end-to-end paths (=diameter, thick 
lines) for HNS of size N = 2 k , k = 2,4,8. Whenever the system size N increases by a 
factor of 4, the diameter d increases by a factor of ~ 2, leading to Eq. @. 



we obtain a hierarchical 3-regular network HN3 by connecting first neighbors in the ID- 
backbone, then 1 to 3, 5 to 7, 9 to 11, etc, for i — 0, next 2 to 6, 10 to 14, etc, for i — 1, 
and 4 to 12, 20 to 28, etc, for % = 2, and so on. The 4-regular network HN4 is obtained 
in the same manner, but connecting to both neighbors in the hierarchy. For HN4 it is 
clearly preferable to extend the line to — oo < n < oo and also connect -1 to 1, -2 to 
2, etc, as well as all negative integers in the above pattern. These networks resemble 
models of ultra-diffusion [TU [15], but with inhibiting barriers replaced by short-cuts 
here. 

It is simple to determine geometric properties. For instance, both networks have 
a clustering coefficient [2] of 1/4. Next, we consider the diameter d, the longest of the 
shortest paths between any two sites, here the end-to-end distance. Using system sizes 
iVfc = 2 k , k = 2, 4, 6, . . ., for HN3, the diameter-path looks like a Koch curve, see Fig. |2j 
The length dk of each marked path is given by c4+2 = 2<4 + 1 for N k +2 = 4A^, hence 

d ~ \/N. (2) 

This property is reminiscent of a square-lattice of N sites, whose diameter (=diagonal) 
is also ~ a/TV. HN3 is thus far from true SW behavior where d ~ In N. 

The geometry of HN4 is more subtle. We consider again the shortest path between 
the origin n = and the end n = N = 2 k . Due to degeneracies at each level, one 
has to probe many levels in the hierarchy to discern a pattern. In fact, any pattern 
evolves for an increasing number of levels before it gets taken over by a new one, with 
two patterns creating degeneracies at the crossover. We find that the paths here do not 
search out the longest possible jump, as in Fig. El Instead, the paths reach quickly to 
some intermediate level and follow consecutive jumps at that level before trailing off in 
the end. This is a key distinguishing feature between HN3 and HN4: Once a level is 
reached in HN4, the entire network can be traversed at that level, while in HN3 one 
must switch to lower levels to progress, see Fig. [TJ 

We derive a recursion equation [16] with the solution 



^\og 2 N 2 2^ N2 (N^oo) (3) 

for the diameter of HN4. Expecting the diameter of a small world to scale as d ~ log N, 
we rewrite Eq. (J3j): 

A n AT\° - + U \/ lo g2 ^ 2 1 m 

d k ~ log 2 N) with a ~ — + -. 4 

log 2 log 2 N 2 2 
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Technically, a diverges with N and the diameter grows faster than any power of log 2 N 
[but less than any power of N, unlike Eq. (j2J)]. In reality, though, a varies only very 
slowly with N, ranging merely from a « 1.44 to ps 1.84 over nine orders of magnitude, 
N = 10 -10 10 . 

As a demonstration of the rich dynamics facilitated by these networks, we have 
modeled diffusion on HN3 and HN4. Starting a random walks at n — 0, we focus here 
only on the mean displacement with time, 

(|n|>~* lM ". (5) 

All walks are controlled by the probability p of a walker to step off the lattice into the 
direction of a long-range jump. In particular, the walker always jumps either to the 
left or right neighbor with probability (1 — p) /2, but makes a long-range jump with 
probability p on HN3, or p/2 to either the left or right on HN4. In both simple 
ID nearest-neighbor walk results for p = with d w = 2 for ordinary diffusion. For 
any probability p > 0, long-range links will dominate the asymptotic behavior, and the 
leading scaling behavior becomes independent of p. 

Adapting the RG for random walks in Refs. [13 [18], we find exact results for HN3. 
The local analysis[19] of the physical fixed point is singular, with a boundary layer 
instead of a Taylor expansion, yielding an anomalous exponent of d w — 2 — log 2 (0) = 
1.3057581 . . ., containing the (irrational) "golden section" <p = (l + y/5) /2. This is a 
remarkable exponent also because it is a rare example of a simple walk with super- 
diffusive (1 < d w < 2) behavior without Levy flights [201 [2H [22], and it would be 
consistent with experiments leading to super-diffusion [23]. We have not been able to 
extend this RG calculation to obtain analytic results for HN4 yet, although the high 
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Figure 3. Rescaled plot of the mean distance (|n|) in HN4 for walks up to t = 10 6 . 
We demonstrate that d w = 1 but with log-corrections by rewriting Eq. ([5]) as 
(|n|) /t ~ V [\ntf. Then we obtain In ((|n|) /<) / In [lni] ~ /3+lnV/ In [lnt] and linearly 
extrapolate (dashed lines) l/ln[lnt] — > 0, estimating /? « —0.18 at the intercept, 
independent of p. An effective "velocity" V could be extracted from the slope. For 
any value besides d w — 1, these extrapolations would not converge. 
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Figure 4. Depiction of (exact) RG step for the Ising model on HN3. Tracing out odd- 
labeled variables x n ±\ for all n = 2(2j + 1), in the left plot leads to the renormalized 
couplings (L', Kq, K[) on the right in terms of the old couplings (L, K , Ki). Unlabeled 
bonds correspond to -£Q>2- HN3 does not contain couplings of type (L,L'), but they 
become relevant during the RG process. Random walks on HN3 lead to a topologically 
equivalent, but more involved RG step |19| . 



degree of symmetry inherent in these networks (and the simple result obtained) suggest 
the possibility. For HN4, an annealed approximation and simulations, evolving some 
2 x 10 7 walks for 10 6 time steps each, suggest a value of d w = 1, see Fig. [31 Hence, 
a walk on HN4 proceeds effectively ballistic, but hardly with linear motion: widely 
fluctuating jumps conspire just so that a single walker extends outward with an on- 
average constant velocity in both directions, yet the walk remains recurrent. Clearly, 
it is easier to traverse HN4 than HN3 because of the above-stated fact that on HN4 a 
walker can progress repeatedly within a hierarchical level. 

We have also studied Ising spin models on HN3 and HN4, with RG and with Monte 
Carlo simulations. First, we consider the RG for the Ising model on HN3. In this case, 
all steps can be done exactly but the result turns out to be trivial (for uniform bonds) 
in the sense that there are no finite-temperature fixed points of the RG flow. Yet, the 
calculation is instructive, highlighting the large number of statistical models that can 
be accessed through the hierarchical nature of the process, and it is almost identical 
in outcome to the treatment below for HN4. That small difference is just enough to 
provide HN4 with a non-trivial T c > 0, which we confirm numerically. 

The RG consists of recursively tracing out odd-relabeled spins x n ±i, see Fig. HI The 
x n ±i are connected to their even-labeled nearest neighbors on the lattice backbone by a 
coupling Kq. At any level, each x n ±i is also connected to one other such spin x nT \ across 
an even-labeled spin x n with n = 2 (2j + 1) in Eq. ([!]) that is exactly once divisible by 
2. Let us call that coupling Ki, all other couplings are Ki>\. During the RG process, 
a new coupling L (dashed line in Fig. HJ) between next-nearest even-labeled neighbors 
emerges. Putting all higher level terms into TZ, we can section the Hamiltonian 

-m= (-pn n ) + K(K 2 ,K 3 ,...), (6) 

{n=2(2j+l)} 

where each sectional Hamiltonian is given by 

n+l 

- f3H n = ^ K x m x m+ i + K 1 x n ^ 1 x n+1 + L (x n _ 2 x n + x n x n+2 ) (7) 

m=n— 2 
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with (Kq, Ki, L) as unrenormalized couplings and we neglected an overall energy scale. 
After tracing out the odd- labeled spins in each exp [—f3H. n ] , we identify the renormalized 
couplings (neglecting I'): 

K' Q = L + - In cosh (2K ) + - In [l + tanh {K x ) tanh 2 (2K )] , 

U = - In [1 + tanh (K x ) tanh 2 (2K )] , (8) 

and K[ = K{+i f. a. % > 1. The high-T solution iTp = L* = is a trivial fixed 
point of Eq. ([5}. Excluding that and eliminating L* yields 1 = tanh (Ki) tanh (2iiTg), 
which has only the T c = solution Kq = oo (where also K-y = J±/T — > oo). Note, 
however, that the RG recursions (jHJ) have a remarkable property due to the hierarchical 
structure of the network: The next-level coupling K\ appears as a free parameter and 
acts as "source term" that could be chosen to represent physically interesting situations, 
e. g. disorder or distance-dependence. For instance, with Ki as an increase function of 
distance = 2* +1 , a non-trivial fixed point could be created. 

In contrast, HN4 provides a non-trivial solution for the Ising model even for uniform 
bonds, as expected for a mean-field system. Again, an exact result for HN4 is elusive, 
although in light of the inherent symmetries such a solution appears possible. Instead, 
we proceed to a Niemeijer-van Leeuwen cumulant expansion [7] and compare with 
our numerical simulations. The Hamiltonian indeed has an elegant hierarchical form 
separating the lattice backbone and long-range couplings: 

2 k k 2 k ~ i 

- f3H = ^2 K X n -lX n + ^2^2 K i X 2^ 1 (2j-l) X ^- 1 (2j+l)- (9) 

n=l i=l j=l 

For the RG, we set -/3H = -(3H - f3V + TZ with 

2 fc-i 2 fe_1 

- (3H = ^ K X 2j-l ( X 2j-2 + %2j) + ^ Lx 2j-2%2j, 

3=1 3=1 



2 



k-l 



PV = J2 K i x v-i x v+i> ( 10 ) 

3=1 



adding new couplings L that emerge during RG, as in Fig. HI Tracing out odd spins 
and relabeling all remaining even spin variables x n — > x' n , 2 , the cumulant expansion 
applied to Eq. ( ITOl) yields a new Hamiltonian — j37i', formally identical to Eq. ([9]), with 
the rescaled couplings 

K' = L + ^ In cosh (2K ) + ^ tanh 2 (2K ) , (11) 

K[ =K 2 + ^- tanh 2 (2K ) , U = -± tanh 2 (2K ) . 

and K[ = K{ + \ for (i > 2). These are the same relation one would obtain for the 
lD-Ising model with nnn couplings, if K\ = L and Ki = for i > 2. In that case, one 
would find - correctly - that there are no non-trivial fixed points. The K 2 — term, which 
appears as an arbitrary source again at every RG step, if chosen appropriately, provides 




Figure 5. Width (w 2 ^ as a function of N. The ID-loop without long-range 
connections diverges most strongly, linear in N, while the random one-per-node SW 
connections keep the width finite. The width diverges with a weak power of N for 
HN3, but merely logarithmically for HN4. 



the sole ingredient for a non-trivial outcome. But unlike for HN3, here already uniform 
(i-independent) Ki obtain T c > 0. Holding the source terms fixed, Ki> 2 = 1, we find a 
single nontrivial fixed point at Kq w 0.2781, K* ps 1.0681, L* ps 0.0681. An analysis of 
the RG flow [7] in Eqs. (112)1 . starting with identical K t = f3, J f. a. i, yields T c « 2. 2545 J. 
Simulations on HN4 with uniform bonds for increasing system sizes N = 2 k accumulate 
to T c = 2.1(1)J. 

Finally, we demonstrate the usefulness of having a regular (i.e., non-random) 
network at hand with fixed, predictable properties. Synchronization is a fundamental 
problem in natural and artificially coupled multicomponent systems [24J. Since the 
introduction of SW networks [I], it has been established that such networks can facilitate 
autonomous synchronization [25| 126] . In a particular synchronization problem the 
nodes are assumed to be task processing units, such as computers or manufacturing 
devices. Let hi(i) be the total task completed by node i at time t and the set 
{hi{t)}iLi constitutes the task-completion (synchronization) landscape, where N is 
the number of nodes. In this model the nodes whose tasks are smaller than those 
of their neighbors are incremented by an exponentially distributed random amount, 
i.e., the node % is incremented, if hi(t) < min j e s i {hj(t)}, where Si is the set of nodes 
connected to node %\ otherwise, it idles. In its simplest form the evolution equation is 
hi(t + 1) = hi(t) + T)i(t) YljeSt ® ~ with iid random variables of unit mean, 

rji(t), 5-correlated in space and time, and 6 as the Heaviside step function. 

The average steady-state spread or width of the synchronization landscape (degree 
of de-synchronization) can be written as w 2 = (1/N) X)i=i(^i — [26] - In low 
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dimensional regular lattices the synchronization landscape belongs to the Kardar- 
Parisi-Zhang [27] universality class, a rough desynchronized state dominated by large- 
amplitude long- wavelength fluctuations, where width diverges with N. On the contrary, 
the width becomes finite [26] on a SW model in which each node is connected to nearest 
neighbors and one random neighbor. In Fig. [51 we show the width as a function of N for 
a ID loop and SW, as well as HN3 and HN4. The width for HN4 behaves very similar 
to SW, with at most a logarithmic divergence in N, while it diverges with power-law 
for HN3, but weaker than for a ID-loop. HN4, thus, provides very similar properties to 
SW with the benefit of a regular and reproducible structure that is easy to manufacture, 
and that is potentially analytically tractable. 

In conclusion, we introduced a new set of hierarchical networks with regular, 
small world properties and demonstrated their usefulness for theory and engineering 
applications with a few examples. Aside from the countless number of statistical models 
that can be explored with RG on these networks, they also provide a systematic way to 
interpolate off a purely geometric lattice into the SW domain, possibly all the way into 
the mean- field regime (for HN4). Even though at this point complete solutions on HN4 
elude the authors, even the leading approximation provides significant insight. 

B.G. was supported by the NSF through grant #0312510 and H.G. was supported 
by the U.S. DOE through DEAC52-06NA25396. 
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